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Rftynulda (1976) cbiicr lb«d ,|iri/<:ir^4«>r"'«nMly«i U procdduro for 
entr^ctlng un I dimensional chdl.ns of U©ms (on p^rsonsi)^ from multl- 
dimensional datas^ts* It U 'an qxhatia 1 1 ve method , using one qf 
CI Iff .consistency Indices to Jxtracr al I possible chal^ns Which 
maintain a given level of ctj)nsist'ency. A practical problem with thts ^ 
method Is tjiat the number of compu^tejUalculat |onV ne(d|d(^ f6r chaTfT^ 
extraction can become very high; , ' ' . /H. 

Thfs paper outlines a procedure whlcK uses^ijkph^theor^t'o e;{<trac:t^ 



^jhre^dujja^nt., chains efficiently, r^.ther thanr e^haustlvelf^^^^rat 
jal |FJfitj|?lns^,^^ Rdynol^'s procedure;. 1 1 a'l so uses cha In consistency 

a^^^orl^loj^ for ^b^O membershlpCl^ domliiancei matrix can be 
reconsTderedn as Oi' labelfed digraph, . 'From this digraph, al l subgroups \t 
wl thvperf^ct coni|1stency .are"generated| and these'' In turn are 6sed as 
startlngj points In the-chain extVa^tlon prd<;fesswThe original dominance 
digraph Is then reduced unti I the chlan Is** founcl frbm each subgraph. ^ S 
This graph-t^ieoret Id algorithm may be carried out'lbl'ng a series of 



matrix manipulations performed on the dominance matrix. 



IXTRACTINO UNIOIHINSIPNAI. CHAINS FROM MUlTIDIMiNHQNAl 
PATASITSj a QRAPH THiORY approach 



. M«tty paychotiitttrlcUns h«v« Investigated th« problcan of extraction 
of f'«ctors or dlinon»lon8 from a d«ta matrix, Ortlerlng theory (Alraslan 
and B«rt, 1972) U one such nmthod. Ordor analysis (Krus, B«rt, & 
Alraalan, 1975) was davblopad to examine the loglc-baaed dimensions In 
binary data matrlcaa. It makes ms^ of the dominance relations (Cpombs, v 
196^) In data to determine simple orders^ 

/Cliff (197J) developed several order consistency Indices from the 
,.d6mlnance relatlon^^ He shows his Indices to be comparable to Classical ' 
measures of Internal consistency such as the Kuder-Rlchardson formula and 
Loevlnger's Index of homogeneity. 

Reynolds (1976) developed, order analysis procedure which u^es 
one of Cliff's consistency Indices to recover all possible chains (I.e., 
all poss/ble dimensions that maintain a given level of cons Instancy) . A 
practical problem with this method Is that the number of computer 
calculations needed for chain extraction can easily become very high. 
This article Is concerned wl th present Ing an efficient algorithm 
' to extract all possible chains using a ^nei^al consistency Index. Our 
extraction procedure Is ai^ interactive method using the PLATO computer 
system at the UnlversI ty of^ llJInQis. The main algorithm uses graph 
theory to extract nbnredundant chains efficiently, rather than 



^TheVau^hors wish to acknowledge the contribution of Robert BalHle, 
who Wi-dte computer programs for the routines developed In this paper^ 
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4Mh«uiMv«ly (i«n«ratlnt) «ll ehtln* wish RnynuM*' 0^/6) ^>|■iH:iiUH 

Th« nitthoUt d««crtb«it In [this piip«ii- ^ra b«««id on tha cont;«(.t» of 
order «n«lysU (Kru*. Urt, & AlrniiUn; I'g/Si Krua. 1975), Qne 
«dv«rit:«ti« ualna ordir analyaU U th«t It U imjV«..e«»ijMy i«*«trtii*d 
In Un«i of orsph theory concenu Chun ura'athur mumvurUN prtKedm 
auch «» factor analyaU and clusimr andlyaU. In the followlna section, 
we will explein th« notation to be used In deacrlblno the extraction 
elgorlthnt. , 
Simple Orders V 

Mathematically, slmpla orders a^e -def I nod as fol lows'. Lot R 
denote a simple ofder relation be^en elements of a\set A. The 
following three properties hold' for all elements a, b, ^nd c of set A: 

1) Asynipatry property 

aRb Implties bRa, where R maans "not R", 

2) Transitivity property 

aRb and bRc implies aRo, 

3) Connectedness propqrty^ 

either aRb or bRa. 
An example of simple order Js shown by the concept "less than". Let 
,A be the set {1, 4f 3, 4}. Then the set R of all ordered pairs of 
elements from A which maintain the /elation "less than" is given by 
R, -{(U2), (1,3), (1,4), (2,3), (2,4), (3,4)}. 
Directed Graphs 

J Graph theory Is a useful tool for helping one to better 
understand complicated sets of relationships (particularly logical 



iliiv#)a|4lniii jjlyuiUNH*, ^ w*i will iihwi^ittM ur^Hh^ im 0l«siH«ifU5| 
trm siau which iM<i)nMtH the* |MiiM«*t(l«^^ ultHi^U iHiki^, 

l«t u?i iloHiUfii 4 d|im;i:tti| tjirtph a hy a (V,t), wimid V i5» th« :*0i 

\ u, - (v,.t,) . • 

V, « A - I l.2.i,'*} 

tjv- R, - tCl.2),(i,i),(i;iO,(2.i).(^.^).(l,^OI 

(ij Cdo rtipriasidntatl yidphlcdlly, ?ihuwn In Flijuid I, 




Figure I . Graph for G 



Notice that the three properties of simple orders (asynimetry, transi- 
tlvlty, and. connectedness) are shown graphically. 
Matrix Representation of Directed Graphs 

In order to represent a dl rected graph *G In a computer, one commonly 
uses a V X V adjacency matrix (D^ j|p|^ ) where g^j « 1 or 0 depending on 
whether or not a directed edge ex I sts' between vertices I and j In V. The 
matrix representation for G^ Is shown In Figure 2. 
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Figure 3. A Persons by Items Data Matrix 

T^e element Sjj of S Is equal to 1 If person I gets Item j correct, 
efid 0 otherwise. In order analysis terms, It Is sdid that when Sjj - 1, 
person I dominates Item J (Krus, 1975).j| Conversely, when Sjj - 0, Item 
J Is said to dominate person K The dat4.matrrx S Is represenfat Ive of 
a perfect Guttman scale. When the Items are ord-- » 1n . n. of difficulty, 
each person will get each Item correct up to a given diftic Jty level, 

\ 

.10 



<ibout «Uiii«Nit% wliriln ttrtih 5ii*t U tUMMi«ii1 Uy i«ro nmit In if>«» siuiiei 



A *• 



0 

S 0 



How«iv<9r, iiifi ulr liiMt^ily toncisjihistl pmcU^ly with th«i <liK«lfMiK« 
r«Uitluiiii betw««n <!|fem«nt^ within If w^ multiply A by lu^lf, wtj 

obtain th« matrix A"^, which c^ntaln^ tha wUhln-nmt donjln-inc*^ Inf orm,iit Ion . 



N' 0 
^ 0 X 



The submatrix N is the Item dominance matrix. Element n,. of N is 

equal to the number of persons for which Item lldomlnatjiid Item J (that is. 

Item I was incorrect and item j was correct). Correspondingly, the 
2 

submatrix X of A Is the person dominance matrix* Element x equals 

St 

the number of Items for which person s dominated person t (that Is, 
t^e number of Items which person s got correct and t got Incorrect), 
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ilh^it^d will u»»U In (» laic*, i |mm Im .ic^vel^p an o^Ma.ilM 

<^ lu« M I llim, 

N»l#inM ih0 hlnnry, I Iwiiti by nun* daila rfwHtlM % fMwn t h*i U^l 

iUm\n^i^^ tlmn \ (%^^ ^ |), Kiuin*i^h %Ih>w% uUt Iff^m | .ji>n»lM«lati 



pur son I o 

. Figure 4a 

Parson 1 Oc)mln«t«ss lt«ii j 



1 1 wri ) u 



parson 



Itam j Donmiatas Person I 



Itam-ltam Oomlnnnce R elations 

Consider a person X responding to two Ite/ns, a\nd b. Since 
person X can get each. Item either right or wrong, there are four possible 



response patterns. 



4 



a ,b ,^ ■ 

1 1 

4 ■ 

^: ■ '. ■ ' " . y- -0 ,0 _ . / •■ ; , 

Only tfie (1,0) and (0,1) response patterns contain order. Information, as 
shQwn tjy the graphs In Figure 5. Paths of length 2 are found only for 
these two response patterns. (A path of length 2 means a succession 
of two arrows, one starting at the other's endpolnt.) 
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o a 



o b 



(1,0) X o 



(0,1) X o 




(0,0) X o 
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o b 



o a 



o b 



o a 



o b 



Figure 5. Possible Two Item Response 



Patterns and their Graphs 



For an entire persons-by-f terns data matrix S, the Item-person 
dominances are easily represented using a bipartite graph. A bipartite 
graph depicts the relations between the elements of one set and the 



1 ^5 



8 



elements of another set. Figure 6 shows a data matrix, Its adjacency 
matrix, and Its corresponding bipartite graph.- 
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» Figure 6. A Data Matrix with Its Adjacency 
Matrix and Bipartite Graph 



1 L-* 



The Item dominance matrix for the dataimatrlx In Figure 6 can also^^ 
be shown by use of a labelled graph. Figures 7a and 7b show this 
dominance matrix and^ Its graph* An element n^^ represents the ngmber 
of Ij dominances* An element n^j represents the number/of jl dominances 
and can also be thought of a;5 the number of I J counterdom I nances. In 
^the gra^hy the numerals In parentheses are related to these dominances 
and counterdom! nances as follows: The second number Is the number of 
dominances In the direction of the referenced arrow, and the first 
number Is the sum of the dominances and counterdominances. 



A 

N = £ B 



ABC 

0 2 2 

1 0 2 
0 1 0 



Figure 7a. Item Dominance 
Matrix for Data Matrix In 
Figure 6. 



(3.2) 




(2.2) 



(3.2) 



FJgure 7b. Labelled Graph 
for Item Dominance Matrix 
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CONSISTENCY INDEX 



We deftne a general consistency Index, C, as ^ 



•C - o(U /U) - e , 
where u' ■ E E n'. (the total number pf Item dominances) 



re J 



J k 



Jk 



U " E E n,. (the number of dominances above' the main diagonal) 
^ J k>J J"^ 

a and 3 are parameters which determtne the scale and orlgfn., 
r«pectlvely, of C. 

For a gtven data matrix^ the total number of dominances (U) Is 
f I'Xed, .whi le- Is dependent on the'order of the Items. When the, Items 
are ordered In terms of difficulty, fs ma:>^mlzed. 

When a » 2 and v3 » .1 , C Is equivalent to the Index used by 
Reyi{o1ds In his exhaustiVe-ftk^hod. This Is also equivalent to C. - , 
(^one of CI Iff 's consistency Indices (Cliff, 1977), since 



^ U . U U U V ^tl 



where U. "EE n,. (the number of dominances below the main diagonal) 

- J k>J ' 

° J k>J ^"Jk- "kj) / ^ ; 

V - E E n . V 

j JK 

It Is also easy to show that with a " 4 and 3 3, C becomes 

■f • 

C^2, another Index proposed by CJIff. 
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, Althought the above equation for C Involves two parameters, 

\i> ■ >• ^ * ^ ' 

a and 0 , It Is/seen that 3 Is a functlon^of a by considering a dataset, 

which forms a Guttman simplex so that U « U and C » 1. Thus^ 

1 .«"*a(l) - 6, or e » a - 1. Hence 

C ».a(U VU) - (a - 1) ^ ' 

Therefore, we have only one parameter a, and Its value Is determijied 
so that C/^Ml be appitpximately equal "to- zero for a dominance matrix 

based on a random set of data. With appropriate choices of a, C can 

■/• / ' > ^- . . • ■ ■ • - . . t ' 

approximate CMff 's C.^, C^. , or C^-, 

/ / ' ^-^ . . 



J-^ -i k>J. -"^ j k>i -"^ 

j- k>j j k<j j l«j ""J^ , 



J k>j: ?^ ' 
/ j k<j J"^ J'' 



where Is the number, of dominances from j to k. 

Cji^ Is the number ol^ounterdomi nances from j to k (=n|^j) 
Or we can say ' 



Z Z d Z Z d. ' ' 

„ J k>J -"^ ^ J k>J -"^ 

Z 2 d. Z Z a . 

j k<j -"^ j k>j 



where a., "c,, +d,,. 
, jk jk jk 

\ 



krujs (1975) showed that ^domlnancd matrfces, c^n be spl it Into 
additive matrices adcord^g to Item or person subsets^ From this, 
letting each person be' treated as a subset, 'we^'have - 

& r 

n n N ' ' n . ri ■ N . 

' ■ 2 2 ^ 7T s . • , Z Z Z d 

C' J k>J I - 1 " Jk ^Ik - J k>i ' 

rf n N _ =_ \ n n ' N 

. . Z ■ Z (s* s + s' : s ) - z Z Z" a.y 

J k<J, 1-1 V A' j k<j 1=1 -"^ 

Z Z Z"^ df'^ - . Z d^'^ 
-I k>l -"^ - l°1 - ' 



Z Z S af') ' , a(') 
l«l J k<J 1=1 



This general consistency Index,^ has the advantage of 

^ddltlvlty bver, the above-mentioned Wdlces C^^, C^^', and C^^. Each 

Item or person carr be thought of a3 having an Individual C value. When 

groOps of Items or persons are combined, both the numerator and ^ 

denominator of the U /U term of C change by an additive amount. This Is 

a 

not the case* for C^^* ^t4' ^t5* ^^'^^ ^T® ^^urither Influenced by 
•"^'chance" cons-lstency In a non-addltTve fashion* 

Mn the ^next Section we utilize this additive property to extract 
all pdsslbl^Vunldlmenslonal chdths In a more efficient fashion, / * 




EXTRACTION PROCEDURE , . 

Our extraction procedure is an Interactive method us I n^ the PLATO 
computer system at the University of Illinois* The main algorit4vn uses 
graph theory to ^extr^ct nonredundant chains efficiently^ rather than 
exhaustively generating al 1 chains, as with^eynolds' (1976) procedure. 

It uses the consistency index C as a Criterion for chain membership, 

, i ■ '/ ■ ■ ' 

taking into account the fact that the numerator and denominator bath 

maintain addi tivi ty^^jjnder addition arjd.^^delet ion of elements in a chain. 

The dominance matrix can be interpreted as a label led digraph. 

From this graph*, alf subgroups with perfect consistency are'generated', 

and these in turn are used as starting points in chain extraction. Giv^n 

a criterion cons,istency value" C^, the original dominance digraph is then 

reduced until a chain Is found from each subgraph. After extracting all . 

possible chains, redundant chains can be el Imi^iated and C can be changed 

' , ' o 

to select more or fewer chains, as desired. : ^V> ' ' 

\ , ^ ' , •■1 ' . ■ " .-^ 

As a backdrop, we first briefly review Reynolds ' (1976) method, 

' ■ . ' ' '* . ' ' <> 

which extracts all possible chains which satisfy the condition that 

criterion C (whl^h Is equivalent to Cliff's consistency index C^^) 

■ ^ 

exceed some cutoff value. His approach is dn iterative method generating 

all chains starting at each item. 

For each Item, k, S consistency value Cp^j^ Is calculated for 

combining the new item with I terns already in the chain. The Item 

which produces the smallest decrement In C ^, Is %dded to the chain, 
* i o p+k . ' 



producing* C' : 



ERIC 



t 



This proems s of adding the *'most consistent^'* Item Is repeated using 
the remaining Items until the overall chain consistency drops below 
the criterion consistency value. At this point the procedure stops 
and the chain Is complete. This method Is reapplied u;^Ing each Item 
al-^^^'s tar ting point so that, for m Items; m chains are extracted. 

■M ' ' • ^ . ^ 

llcate chains are deleted, leaving a unique set of ^alns that are 



, ^Interpreted as the dimensions of the data matrix (|ieynolds/ 1976). 



V vleynolds' procedure tolerates a lot of redundancy In order to 
^ ensure' that all chains are extracted. That Is, for each Item In a 

given chal^n, using It as a starting point will frequeTitly result In 

the re-product Ion of an ^already existing chain. ^. 

v^Jlie /total number of possible consistency calculations for a ^ 

k- 1 tern data matrix can be computed. Starting at each Item there are 

k(k-l) 



(k-1) + (k-2) + ... + (k-k-1) 



calculations. Summed across starting points (Items), we Have a* total of 

, ■ 3 
jcalculatlofis, which Is, of the ord^ of k . As k Increases the number 

of calculations needed goes up rapidly; For Instance, for a 20-Item ' 

data matrix, as many as 3800 calculations jnay be needed.^ Many of 

these calculations are unnecessary. 

* ^ * 

. Our. algorithm, oh the other hand, begins by determining atl 
subsets of Items with perfect cons! stency (C»l .0) ; that Is, subsets 
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which satisfy 




C - \ - 1.0 

P 



where p denotes any chain of Items with Col. (A chain cbnslsting 
of only one Item Is permissible.) Note that th^re will likely be 
more than one starting Item ch^In. At- this point, items are added 
one by one to a giverf chain in such a way that ' ts-cons I stency stays 
as high as possible. When its value droops to some predetermined C^, 
we stop adding further Items to this chain, but select another chain 
and repeat the procedure. „ 

We have considered three different strate^^Ies for deciding on 
the successive Items to add to a chain: . 

(1) Take each or>e of the remaining Items In turn, calculate the 
new consistency index when each I^ added to >the chain, 'and select that , 
item which yields the ISirgest C value. This Is essentially the same 
as Reynolds' (1976) procedure, and ft Is t ime consuming' because 
repetitious calculations have to be done for each Item Irvturn. 

. ^ (2) Wrthout taking the chain as a whole Into consideration, 
look at the 'Mndividual" consistency index \ • - 

of each remaining Item, and choose the Item with the largest C, ^ 

. - , Ind 

to addto the chain. (Note, however, that each time an item Is added 
to a chain, the Individual cons Istency Index for each of the remaining 
Items has to be calculated anew,) 
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(3) Out of the remaining Items, take the three with the highest 
Individual consistency values, and add each one of these, In turn, to 
the chain. Choose the one that' produces the smallest decrease In the 
overall chain consistency to actual l^add to the chain. (This 
method Is to allow for the possibility — which we have not experienced 
so far that the Item with the highest Individual consistency, 
selected by method (2), may not necessarily produce the smallest 
decrease In the chain consistency.) 

Our computer algorithm can use any of the thred^ strategies just 
described; moreover, even when method (1) Is used, we have made 
arrangements to keep the repetitious calculations at a minimum. We 
shall now describe our algorithm In detail , giving an example using 
the second strategy. 

Chain Extraction Algorithm ^ ^ 

1. Start wVth a personc x Items data matrix. 
Kl Compute the dominance matrix. ' ' 



kj - 1,2,, 



Note that this matrix Is not a binary matrix and that njj =» 0. 
Reorder the dominance matrix In terms of Item difficulties. 
1.2 Coostruct a matrix 0 such that each element In |ts^4ower 
triangle Is equal to the sum of the corresponding eiCnent of N 
plus the synj^trlc element 6f N. The upper triangle eleiTients are 
fequal to the corresponding element of N and the main diagonal 
elements are al 1 zero, Th^t Is, 



/ 
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> < J 

where Ojj " < 0 ' ■ j . \ 

2. 'Graph Initialization \ 

2.1 Construct a labelled graph from matrix 0. 

G - (V,E) 

V " fl,2 m }' (the total set of Items) 

E-f(r,J) l-l,2,...,m; j-l+1,1+2 m }\ 

2.2 Initialize labels for vertices and edges: 

®lj " ^^jl' '^IJ? " ^°jl'°|j^ for 1-1,2,. ..,m; >I+M+2,:..,m 

V| - CP,.q,l [9,0] for 1-1,2, ...-,m 
The graph labels refer to the 'consistencies both between vertices 
and "within" vertices. As the algorithm proceeds, soMe of the I 
vertices will be merged to form new vertices. ■ Each v, wl 1 1 ref erVto 
the consistency of the set of Items within vertex -1. Hence, each 
P, Is equal to the sum of the elements in the fower triangle of 0 
that correspond to the fiomlnances between elements contained In 
vertex I. Likewise, qj Is equal to the sum of the /:or res ponding 
elements of the upper triangle of 0. Thus, each Vj Is Initialized 
at [0,0] . 

2.3 Initialize a chain matrix (CH) 

Thii will start out as an m.x m binary matrix that will contain 
the.lton chains. All elements of CH wl 1 1 be Initialized at zero 
except for the main diagonal elements, which are equal to one. When 

' O Q 
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the algorithm Is finished, ch^j will equal one If Item J Is a l 
member of chain I; otherwise, ll will beequal to zero. Also, 
redundant chains will be eliminated during the extraction process, 
so thaV the final number of chains (rows) In CH will be less than m. 

3. Extraction of maximal chain with a consistency greater than a 

criterion, C* • 

3.1 For a given chain L, merge the vertices and edges Included In 
the chain. For vertices I and j (I<j) where chj^j«l and ch^.j«0, 
merge vertices I and j to form vertex I«j with edges 

(k,irj) • k < I 



(l-J,k) 



I < k 



for all k e V-{l,j}/ 



The new labels In the graph are: 

^1 



'm 

'•J 


[P, + Pj 


+ aj,, q, + qj + d,j 






k,l-j 




"jk' ^kl " \} ) 


k < 




I'j.k 




^jk' ^Ik ^kj ^ ^ 


\ < 


k < 


I-j,k 




^kj- '^Ik '^jk^ 


k > 


j . 



3' 2 Look for the candidate vertex (Item) which should be merged next. 
Find the Item with the largest "Individual" consistency (strategy 2) 

t.ll; 



/k,l-JJ2 
C\,|.j]l 

C^i.j-.kli 



k < I 



k > I 



where [e^ and [e^ are the first and second components of 

e and I'j represents . I terns al ready In the chain, 
a , D 
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3.3 Compute the new consistency (C) with the best .Candidate Itw, 
added to the chain.* 

k, -j p. . + a. , . ^ * r 

or 

3.^ If C > then add vertex k to the chain and merge the graph. 
Return to step 3.2 . 

If C < , the algorithm is finished. 



13 
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AN ILLUSTRATIVE EXAMPLE 



W« will now 11 lust fate th« use of our algorithm using the example 

m 

gfven \t\ Reynolds (1976, p» 2k). The consistency Index he used Is 
equivalent to our general consistency Index with parameters a « 2 and 

e - K 

K Data Matrix 
J.l The ordered Item dominance matrix for the six Items Is: , 







F e 


1. 
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A 


B 




F 
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k 


5 
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li 






k 


3 


N ■ S» X S 


E ' 




1 




3" 


^ 




C 


1 0 


2' 


0 




2 




A 


i) 2 


1 


3 


0 


3 




B 


0 0 


1 


0 


2 


0 


The corresponding 0 


matrix Is: 














F -D 


E 


C 


A 


B 




F 


0 3 


2 


i» 




5' 




D 


i» 0 


2 


1 




3 


0 - 


E 


2 k 


0 


3 


3 


i» 




C 


5 1 


5 


0 


i» 


2 




A 


4 6 


i» 


7 


0 


3 




B 


5 3 


5 


2 


5 


0 



2. Graph Initialization 
2J, 2.2 The labelled graph corresponding to matrix 0 Is shown below. 
In Figure 8. 
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2.3 initialize the chafn matrix (CH). ' " 
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DEC 


A B 
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" I 


0 0 0 


0 0' 




f\ 

0 


1 0 U 


0 0 


3 


0 


0 1 0 


0 0 


k 


0 


0 0 1 




5 


0 


0 V 0 


h 


6 


0 

- ■ -\ 


0 0 0 


0 1 

m 



.1 

3^ Extraction of Perfect Item Chains (C « 1«0) • 
3.1, 3.2 Select vertlqes with perfect consistency (C - 1.0) for 
each chaln» and delete redundant chains. ^ 
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0 
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Repeat step 3. for a lower criterion consistency. 

A, Extraction of Maximal Chain greater than a Criterion Consistency (C 

7 . ■ ■ ■ ' 

k.\ Herge vertices and edges Included In the chain. 
^ We. get Figure 9* Note that chain 1 Is bejng processed. 

28 
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(10,9) 



Figure 9. Merging of Vertices for Chain I 



^.2 Determine the next candldcite Item. 

Of these 5/8, 7/10, 7/8, and 9/10, the value 9/10 Is the largest. 

Therefore the vertex B Is the candidate. 
^.3 Comput/ c (o - 2, ]3 - 1) for the chain with the candidate added. 

c - 2(2+9)/(2+io)-i - ."esa^ 

If C > then add candidate Item to chain, merge the graph and 



return to. step 3.2. If C < C^, do not add candjidate Item and chain 
Is complete. C (-.8333) > (-.8) so we add the candidate, merge 
the graph and get CH matrix and Figure 10. 
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CH 



1 
2 
5 
6 



F D E J! A B 

'I 0 10 0 I 

0 1 0 10 1 

10 0 0 1 0 

10 0 0 0 1 




Figure 10. Merging of Vert^ F, E and B 

We repeat the 4.2 throu£(h k.k. This time vertex A Jbecomes the 
candidate because 10/13 Is the largest value, but the new 
C - 2(11+10)/(12+13)-1 - .68 < C(-.8), so the algorithm then stops. 
Repealting the process for the other chains, we get the final chain 



matrix (C ■ .8). 
o 



CH 



1 
2 
5 



F .D E C A B 

'l 0 1 0 0 1 

1 1 0 1 0 1 

1 0 1 0 10 



.5161 
.8333 
.8000 
.8000 
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Th« valu« In th« uppar rlflht-hund corn«r (tSlfil) Is th« C value fo 

■ 1 

a chain contnlntng all of the Itama, Note that each Individual 

chain represents an Improvement over •5161. 
The Interactive procedure to extract chains la summarized jn 
Figure 11, , Each block consists of one or more routines wh1%h are 
Imp lamented, on the PLATO system at the University of Illinois. 



} ■ 
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OENERATC 
aCONES 



COMPUTE 
S *T 



£ 



TYPE It 
IN CHAIN 
MATRIX 



SORT 
DATA 

HI 



CONSTRUCT 
0 MATRIX a 
CHAIN MATRIXES 



I 



COMPUTE 
"SFx S 



CALCULATE 
C 



LOOK FOR 
A CHAIN 



SEE CHAIN 
MATRik a 

C».'. 



1 r 

(InT) 



Figure IK Extracting procedure on, PLATO system. C / 
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DISCUSSION 

W« IntroduQfd « gunti^A) contlittncy In^nx In thli paptr luch thut* 
with p«r«m«urs v«lu«t oi » 2 ind 0 » h It li aqulviUnt to the Index 
which Reynolds (1976) used In hit article, end eUo to one of Cliff 
Indlcesp C^^ (1977)*. Wlth^a - end e • 3 It hecomei C^^, enother Index 
by Cliff. With epproprlete choice of a (end 3 ■ a^'l) we can 
epproxtmate others of Cliff's Indices, C^j, C^j^, end C^^. 

One Importent feeture of t^e general consistency Index Is that 
eddltlvtty holds In both numerator and denominator. It enables us 
to use a graphical merging technique. As a result we can give an 
efficient algorithm to get ell possible chains, which were obtained 
by Reynolds by his exhaustive method, ^ 

In the current paper we have picked up the Items In order \o get ' 
Item chains. But we can easily extend the technique described here to 
a method that both picks up Items and eliminates persons In order to 
get hlghly^cons I stent Item chains* because addltlvlty In numerator and 
denominator holds for persons as well as Items, In some cases a 
few parsons "contaminate" our data» therefore elimination of these 
persons Is a good way to get good Item chains. Our efficient algorithm 
ensures the extracting of^qAalns for a large number of Items and 
persons. We can also apply the same technique to get consistent 
person chains* /by picking up or eliminating Items or persons. 
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